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Adaptive- Weighted Packet Scheduler for Supporting 



Premium Service in a Communications Network 



Field of the Invention 

This invention relates generally to communications networks, and more 
5 particularly, to enhancing service in a packet switched network. 

Background of the Invention 

In the absence of quality-of-service (QoS) measures, best-effort service is 
10 the default behavior of packet-switched networks. Routers in the network 
make a best effort to deliver a packet, but may drop packets indiscriminately 
in the event of network congestion. The routers managing bandwidth and 
prioritize delay-sensitive packets. The Internet today is a good example of 
best-effort service. Best-effort is suitable for a wide range of networked 
15 applications such as general file transfers or e-mail. 

However, there are many functions which are considered relatively more 
important or urgent than others. For example, in some applications involving 
the world-wide web (the "web"), it might be considered more important to 

20 receive and process commercial transactions than to permit browsing of 
certain types of information. Functions can also be considered relatively 
more important or urgent dependent on context. For example, a processing 
resource becomes overloaded. In such a case, it may be desired to give 
certain packets priority. For real-time streaming applications, such as 

25 audio/video deliver, jitter is a concern. 
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Jitter is distortion of a signal as it is propagated through the network, where 
the signal varies from its original reference timing, and packets do not arrive 
at a destination in consecutive order or on a timely basis, i.e., the packets 
5 vary in latency. In packet-switched networks, jitter is a distortion of the 
interpacket arrival times compared to the interpacket times of the original 
transmission. Also referred to as delay variance. This distortion is 
particularly damaging to multimedia traffic. 

10 Therefore, many network, such as the Internet define a concept called 

quality of service (QoS). QoS is set of actions the network takes to configure 
and signal according to a particular traffic classification. QoS collectively 
measures the level of service delivered. QoS can be characterized by several 
basic performance criteria, including availability, error performance, 

15 response time and throughput, lost calls or transmissions due to network 
congestion, connection set-up time, and speed of fault detection and 
correction. Internet Service Providers ISPs) may guarantee a particular level 
of QoS, defined by a service level agreement (SLA). QoS solutions sort and 
classify packet requests into different traffic classes and allocates the proper 

20 resources to direct traffic based on various criteria including application 
type, user or application ID, source or destination IP address, time of day, 
and other user-specified variables. 

In order to provide end-to-end quality-of-service in the Internet, the Internet 
25 Engineering Task Force (IETF) has defined two major architectures for 
augmenting best-effort service, namely, Integrated Services (IntServ), and 
Differentiated Services (DiffServ). 
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In the network data plane of the IntServ architecture, scheduling schemes 
such as Weighted Fair Queuing (WFQ), Virtual Clock (VC) and Rate- 
Controlled Earliest Deadline First (RC-EDF) have been proposed to support 
5 guaranteed service. In the control plane, a signaling protocol called a 

Resource ReSerVation Protocol (RSVP) is required to perform admission 
control and resource reservation. While IntServ provides excellent quality of 
service, it requires per-flow management at core routers, which places an 
unbearable burden on core routers. 



Due to the poor scalability of the IntServ architecture, DiffServ has been 
proposed as an alternative architecture. DiffServ is an IETF standard 
utilizing a small, well-defined set of per-packet building blocks from which 
a variety of services may be built to provide a framework for delivering 
15 quality of service (QoS) in networks. At least two service classes have been 
defined under this effort, "Assured Service" and "Preferred Service." 

DiffServ can provide expedited handling appropriate for a wide class of 
applications, including lower delay for mission-critical applications and 
20 packet voice applications. DiffServ-capable routers need only to track a 

small number of per-hop behaviors, and the routers service packets based on 
a single byte. Typically, DiffServ is associated with a coarse level of packet 
classification. 

25 In the network data plane of the DiffServ, per-flow state management at core 
routers are eliminated. Based on bit patterns of the differentiated service 
(DS) field in the IP header, IP flows are classified into different aggregates. 
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A core router merely implements simple scheduling and buffering 
mechanisms to serve the aggregated flows. In other words, the services are 
provided for aggregates, instead of individual flows, and defined by a small 
set of Per-Hop Behaviors (PHBs). 

5 

Per Hop Behavior is the forwarding treatment given to a specific class of 
traffic, based on criteria defined in the DS. Routers and switches use PHBs 
to determine priorities for servicing various traffic flows. A PHB group is a 
set of one or more PHBs that can only be meaningfully specified and 
10 implemented simultaneously, due to a common constraint applying to all 
PHBs in the set such as a queue servicing or queue management policy. A 
PHB group provides a service building block that allows a set of related 
forwarding behaviors to be specified together, e.g., four dropping priorities. 

15 By pushing the complexity to edge routers, DiffServ's data plane is much 
more scalable than IntServ. While DiffServ is more scalable, it still requires 
the support of admission control, resource provisioning, and service-level 
agreement on the control plane. 

20 A bandwidth broker architecture has been proposed to perform admission 
control and resource provisioning in each network domain. A bandwidth 
broker is a traffic manager deployed at congestion points, such as routers, 
that limits access to network resources. The bandwidth broker decouples 
QoS control from core routers. Core routers do not maintain any QoS 

25 reservation state, all reservation states are stored and managed by bandwidth 
brokers. However, a bandwidth broker cannot coordinate multiple traffic 
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flows or resolve conflicting QoS requests made by multiple domains, and is 
therefore not an end-to-end QoS solution. 

For the packet scheduling discipline in the data plane, a number of 
5 mechanisms are available to implement the coarse-grain QoS support. 

Besides priority queuing and weighted round robin scheduler, a Class Based 
Queuing (CBQ) scheduler is a possible implementation to meet the 
requirements of forwarding behaviors in DiffServ architecture, in which the 
EF queue is given the priority up to the configured rate. 



Currently, three types of PHBs are included in DiffServ architecture, which 
are Expedited Forwarding (EF) PHB. Assured Forwarding (AF) PHB, and 
Best-Effort (BE) PHB. The EF is to support premium service in DiffServ, 
which has been proposed as a virtual leased line. Providing low loss rate, 
15 low delay, low delay jitter and assured throughput are the commitments 
made by premium service. AF only provides low loss rate, but no guarantee 
on delay and delay jitter. 

To implement premium service in IP networks, a packet scheduler at a router 
20 is essential to meet the EF commitments. Among the various proposed 

packet-scheduling schemes, priority queuing and weighted round robin have 
attracted attention to realize EF due to their simplicity. Results have shown 
that priority queuing can provide lower delay, and lower delay jitter to a EF 
flow than weighted round robin does. This result is no surprise, because in 
25 priority queuing scheduler, the priority queue is always serviced before any 
other queue so that a timely packet delivery is guaranteed. 
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However, priority queuing can introduce larger burstiness because the EF 
packets do not get interleaved with any other packets that belong to a 
different behavior aggregate (BA). A behavior aggregate is a set of packets 
with the same DS field pattern in a forwarding path. 



The aggregation of EF flows leads to cluster of EF packets, and the EF 
burstiness increases as more EF flows aggregate at core routers. These side 
effects brought by priority queuing can cause the EF packet arrival rate to 
exceed the reserved service rate at core routers, resulting in packet losses. 



It is also known that priority queuing can lead to increased burstiness and 
bursty packet loss. Moreover, priority queuing allows exhaustive bandwidth 
consumption by EF flows, which can cause starvation to other behavior 
aggregates. The weighted round robin, or weighted fair queuing scheduling 
15 scheme does not have such drawbacks, but the traffic distortion inside the 
network and the dynamic flow aggregation make the static weights hard to 
work well at routers. 

To provide for no, or very small queuing delay, the premium service 
20 requires that the maximum arrival rate of the EF aggregate at every transit 
node is always less than the aggregate's minimum departure rate. There are 
two prerequisites to meet this requirement: the EF aggregate has a well- 
defined minimum departure rate, which is independent of the dynamic state 
of the router; and the EF aggregate is conditioned, which includes policing 
25 and shaping, to ensure that its arrival rate at any router is less than the 
router's configured minimum departure rate. 
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Unfortunately, traffic conditioning is only performed at edge routers. Traffic 
distortion inside the network such as packets clustering could violate the 
promised traffic specification easily. Furthermore, in each router, the 
number of flows in EF aggregates changes with the joining or leaving of 
5 individual EF flows, so the minimum departure rate for EF aggregate should 
be dynamically adjusted to meet the change of traffic profile. Without the 
support of rigid admission control and accurate traffic conditioning, the 
static setting of weights could cause bursty packet losses because a relatively 
small buffer space is used for premium service. 



Therefore, there is a need for a packet scheduler that supports premium 
service in a communications network. The scheduler should dynamically 
adapt to different traffic flow aggregates, without requiring rigid admission 
control. Burstiness in the network should be absorbed without packet loss or 
1 5 increased queuing delays . 

Summary of the Invention 

This invention provides a method for scheduling packet deliver for premium 
20 service in a differentiated services architecture network. The method can use 
weighted packet scheduling policies, such as, weighted round robin or fair 
queuing. As an object of the invention, the present scheduling method 
adaptively changes the scheduling weights of behavior aggregates, instead of 
adhering to certain fixed values as in the prior art. By adaptively adjusting 
25 the weights with the dynamics of the average queue size of premium service, 
the method according to the invention achieves low packet loss rate, low 
delay and low delay jitter for the premium service. 
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In addition, the present method is flexible, and does not require rigid 
admission control and accurate traffic conditioning to support premium 
service in a differentiated service architecture. Transient burstiness of 
5 expedited forwarding aggregate, which is caused by the traffic distortion 
inside the network, can be absorbed without packet loss and increased 
queuing delay. 

The method according to the invention uses a buffer to accommodate 
10 transient burstiness for premium service. The method uses exponential 
weight moving average (EWMA) to estimate an average queue size for 
premium service, which is the index used for calibrating the weights. The 
weight of premium service is adaptively adjusted, according to the dynamics 
of average queue size. 



By maintaining a very small average queue size, low queuing delay is 
achieved. Also, a small queue weight is used to reduce the fluctuation of 
instant queue size, leading to low delay jitter. To provide different 
forwarding services, in DiffServ architecture each Behavior Aggregate has 
20 its own buffer space at core routers, instead of a commonly shared buffer. 

More particularly, a method schedules packets in a router of a packet- 
switched network. The network has a set of service classes including a 
premium service, an assured service, and a best-effort service. The router 
25 includes one queue for each service class. Each queue stores packets to be 
transmitted according to the associated service class. The method measures 
an exponential weighted moving average queue length of the queue 
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associated with the premium service each time a packet is stored in that 
queue. Bandwidth is increased if the average increases over a minimum 
threshold. The bandwidth remains below an upper limit once the average 
reaches a maximum threshold. 

Brief Description of the Drawings 

Figure 1 is a block diagram of a packet- switched network that uses the 
scheduler according to the invention; 

Figure 2 is a block diagram of a router of the network of Figure 1 ; 

Figure 3 is a block diagram of an output buffer of the router of Figure 2 
including three queues; 

Figure 4 is a graph of average queue length over time; and 

Figure 5 is a flow diagram of a method for scheduling according to the 
invention. 

Detailed Description of the Preferred Embodiment 



Figure 1 shows a packet-switched communications network that uses our 
invention. The network includes a number of host computers 1 10 that can 
25 transmit and receive messages (packets). Routers of the network process the 
packets. Edge routers (ER) 120 are connected to the host computers 1 10, and 
core routers (CR) 130 connect routers to each other inside the network. 
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Figure 2 shows a router. The router connects input lines 201 at input ports to 
a switch 220. The switch 220 uses a routing table 221 to route packets to 
output buffers 230 at output ports connected to output lines 206. 

5 

Figure 3 shows one of the output buffers 230. Each buffer includes three 
queues. An EF queue 301 stores premium service packets, an AF queue 302 
stores assured service packets, and a BE queue 303 stores best-effort 
packets. It should be understood, that other types of packet-switched 
10 network may include a different set of services, and hence a different 
number of queues. 

Each queue has a size s that indicates the maximum number of packets that 
can be stored in the queue, and a length / that indicates the current number of 
15 packets stored in the queue. The size s is static, while the length / varies over 
time. 

Packets are delivered to the corresponding output line 209 according to a 
bandwidth- weighted formulation: 



where EF W is the weight of premium service, AF W is the weight of assured 
service, and BE W is the weight of best-effort. That is, the weights determine 
the relative amount of bandwidth on the output line that is allocated to 
packets in the corresponding queues. If the weight associated with the EF 
25 queue is high, for example, then premium service packets are allocated more 
bandwidth and given preferential service. 
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Figure 4 shows the dynamic behavior of the EF queue 301 over time. The x- 
axis indicates time (T), and the y-axis indicates a current number of packets 
stored in the EF queue 301. The curve 403 shows the instantaneous queue 
length / over time, and curve 404 the average queue length. 

5 

To adaptively calibrate the weight EF W of premium service according to the 
invention, a minimum threshold (T min ) 401 and a maximum threshold (T maj ) 
402 are provided. The minimum threshold represents a desired delay, the 
maximum threshold (T^) represents an acceptable delay. The delay 
10 corresponds to the number of packets that are currently stored in the queue. 
That is, the longer the queue, the longer the delay before a packet is 
transmitted. 

Our invention provides an adaptive-weighted method for scheduling packets 
15 in the communications network. Our scheduling method is elastic to traffic 
distortion and the dynamics of flow aggregation in the network. Our method 
can be applied to both weighted round robin and fair queuing schemes. 

Adaptive Weight Calibration 



As shown in Figure 5, our method 500 determines 510 an average queue 
length (avg) 51 1 of the premium service queue 301. This average length is 
used as an index to adaptively adjust the weights EF W 521, AF W 522, and 
BE W 523 in step 520. The average is recomputed every time a packet is 
25 stored in the queue 301. 
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The average queue length avg of the premium service queue 301 is 
determined using a low-pass filter / with an exponential weighted moving 
average. The purpose of the low-pass filter is to dampen oscillations in the 
average as the queue length changes rapidly in response to varying network 
5 condition. 

If avg 51 1 is the average queue length, and / 501 is the instantaneous queue 
length, and// is the low-pass filter, the determination of the average queue 
length is determined by: 
10 avg<-(l-/,)-avg + / f 

To reduce fluctuations in the average queue length, the low-pass filter// is 
set to 0.0 L This results in low delay jitter. 

15 Low queuing delay can be achieved by keeping the average queue length 
avg below the maximum threshold T max . To accomplish this, the weight of 
premium service (EF W ) 521 is increased whenever the average queue length 
exceeds the minimum threshold T min 401. 

20 However, the weight of premium service is not allowed to exceed a 

predetermined upper limit {upper), when the average queue length reaches 
the maximum threshold 402. This avoids degrading the method to 
simple priority queuing, which can lead to packet clustering as described 
above. 



In our method, the relationship between the weight of premium service and 
the average queue size is linear. If the original weight of premium service is 
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w p , then a weight function of premium service EF W 521, as a function of avg, 
can be expressed as: 



5 If the whole weight is 7, then EF W + AF W + BE W = 7, where EF W is the 

weight of premium service, AF W is the weight of assured service, and BE W is 
the weight of best-effort. 

We set the upper limit (upper of EF W to 0.7, the rest of the weight (03) is 
10 used by assured service and best-effort service. Because the whole weight 
for the shared link is fixed, the increase of weight of premium service leads 
to the same amount of decrease of the weight of best-effort, or the weight of 
assured service. 

15 We apply the following rules. We first transfer some of the weight of best- 
effort to premium service. If the weight of premium service does not reach 
its upper limit, then part of the weight of assured service is transferred to 
premium service. After the average queue size of premium service decreases 
below Tman the weights taken from best-effort or assured service is returned 

20 correspondingly. 

In order to meet the commitment of no or very small queuing delay for 
premium service, we set the minimum threshold T min to 0.5 and the 
maximum threshold 7^ to 2, as measured in packets. 



EF. 



(upper - w )• {avg- T^) 
< 



upper, 



avg e [0,0.5) 
avg e [0.5,2) 
avgs [2,s) 
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Our adaptive-weighted scheduling method for premium service in DiffServ 
adaptively changes the scheduling weights of behavior aggregates with the 
dynamics of average queue size of premium service. Our method absorbs 
5 traffic distortion inside a network without degrading delay or jitter. 

Moreover, our method does not require rigid admission control and accurate 
traffic conditioning to support premium service in DiffServ architecture. 

Although the invention has been described by way of examples of preferred 
10 embodiments, it is to be understood that various other adaptations and 
modifications may be made within the spirit and scope of the invention. 
Therefore, it is the object of the appended claims to cover all such variations 
and modifications as come within the true spirit and scope of the invention. 
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